Skip to content

TICL: Consolidate v5 as Default Configuration and Cleanup Legacy Code#49932

Merged
cmsbuild merged 29 commits into
cms-sw:masterfrom
felicepantaleo:make_ticlv5_default_16_1_0_pre1
May 19, 2026
Merged

TICL: Consolidate v5 as Default Configuration and Cleanup Legacy Code#49932
cmsbuild merged 29 commits into
cms-sw:masterfrom
felicepantaleo:make_ticlv5_default_16_1_0_pre1

Conversation

@felicepantaleo
Copy link
Copy Markdown
Contributor

This PR establishes TICL v5 as the default reconstruction configuration, removing the need for explicit process modifiers and cleaning up significant amounts of legacy code associated with previous versions.

Key Changes:

  • Core Configuration:

  • Updated RecoHGCal/TICL/python/iterativeTICL_cff.py to use the TICL v5 chain (CLUE3DHigh -> TracksterLinks -> TICLCandidate) by default.

  • Removed fallback logic for v4.

  • Switched CLUE3DHighStep to use PFN inference by default.

  • Introduced ticl_dev process modifier for future development.

  • C++ Plugins:

  • PFTICLProducer: Simplified logic by removing the isTICLv5_ switch. The default behavior now assumes TICL v5 timing from TICLCandidate.

  • PatternRecognition: Enabled computeLocalTime by default in PatternRecognitionbyCLUE3D and PatternRecognitionbyCA. Enabled usePCACleaning by default in PatternRecognitionbyCLUE3D.

  • Validation & DQM:

  • Updated HGCalValidator to validate ticlCandidate and ticlTracksterLinks collections by default.

  • Updated makeHGCalValidationPlots.py to plot v5 collections.

  • Updated RecoHGCal_EventContent_cff.py to consolidate keep statements for v5 collections.

  • Fixed handling of empty collections in validator plugins.

  • Cleanup:

  • Removed obsolete process modifiers: ticl_v4, ticl_v5, clue3D, fastJetTICL, enableCPfromPU.

  • Removed deprecated Python configurations: ticl_iterations.py, customiseForTICLv5_cff.py, customiseTICLFromReco.py.

  • Removed legacy TracksterInferenceByCNNv4 implementation.

  • Removed deprecated harvestHGCalValidationPlots.py script.

  • HLT & Workflows:

  • Updated HLT 75e33 and Scouting menus to use TICL v5 components.

  • Removed obsolete HLT modules (hltParticleFlowSuperClusterHGCalFromTICLL1Seeded, hltParticleFlowSuperClusterHGCalFromTICLUnseeded).

  • Updated PyReleaseValidation workflows to reflect the removal of the ticl_v5 modifier.

Testing:

  • Standard matrix workflows.
  • HGCal validation suites.

Notes:

This PR represents a major consolidation of the TICL configuration, simplifying the codebase and establishing a clean baseline for future developments.

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jan 24, 2026

cms-bot internal usage

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

@cmsbuild please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49932/47681

@cmsbuild
Copy link
Copy Markdown
Contributor

A new Pull Request was created by @felicepantaleo for master.

It involves the following packages:

  • Configuration/EventContent (operations)
  • Configuration/ProcessModifiers (operations)
  • Configuration/PyReleaseValidation (pdmv)
  • HLTrigger/Configuration (hlt)
  • RecoEcal/EgammaClusterProducers (reconstruction)
  • RecoHGCal/Configuration (reconstruction)
  • RecoHGCal/TICL (reconstruction)
  • RecoLocalCalo/HGCalRecProducers (reconstruction)
  • RecoParticleFlow/PFClusterProducer (reconstruction)
  • SimCalorimetry/HGCalAssociatorProducers (simulation)
  • SimCalorimetry/HGCalSimProducers (simulation)
  • Validation/Configuration (dqm, simulation)
  • Validation/HGCalValidation (dqm)

@AdrianoDee, @DickyChant, @Martin-Grunewald, @Moanwar, @antoniovagnerini, @civanch, @ctarricone, @davidlange6, @fabiocos, @ftenchini, @gabrielmscampos, @jfernan2, @kpedro88, @mandrenguyen, @mdhildreth, @miquork, @mmusich, @nothingface0, @rseidita, @srimanob can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @Prasant1993, @ReyerBand, @Sam-Harper, @SohamBhattacharya, @VourMa, @a-kapoor, @afiqaize, @apsallid, @argiro, @bsunanda, @cseez, @denizsun, @edjtscott, @fabiocos, @forthommel, @hatakeyamak, @jainshilpi, @lecriste, @lgray, @makortel, @missirol, @mmarionncern, @mmusich, @pfs, @ram1123, @rchatter, @rovere, @salimcerci, @sameasy, @seemasharmafnal, @sethzenz, @slomeo, @sobhatta, @thomreis, @valsdav, @vandreev11, @varuns23, @wang0jin this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Size: This PR adds an extra 452KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-667298/50874/summary.html
COMMIT: 9311241
CMSSW: CMSSW_16_1_X_2026-01-24-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/49932/50874/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 1 errors in the following unit tests:

---> test testProduceNanoHLT had ERRORS

Comparison Summary

Summary:

  • You potentially removed 127 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 4274 differences found in the comparisons
  • DQMHistoTests: Total files compared: 52
  • DQMHistoTests: Total histograms compared: 4021886
  • DQMHistoTests: Total failures: 1526
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4020340
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 5501.189 KiB( 51 files compared)
  • DQMHistoSizes: changed ( 34434.0,... ): 844.816 KiB HGCAL/HGCalValidator
  • DQMHistoSizes: changed ( 34434.0,... ): 424.385 KiB HLT/HGCAL
  • Checked 222 log files, 193 edm output root files, 52 DQM output files
  • TriggerResults: found differences in 5 / 50 workflows

Max Memory Comparisons exceeding threshold

@cms-sw/core-l2 , I found 9 workflow step(s) with memory usage exceeding the error threshold:

Expand to see workflows ...
  • Error: Workflow 34434.0_TTbar_14TeV+Run4D121 step3 max memory diff 270.5 exceeds +/- 90.0 MiB
  • Error: Workflow 34434.0_TTbar_14TeV+Run4D121 step2 max memory diff 508.8 exceeds +/- 90.0 MiB
  • Error: Workflow 34434.75_TTbar_14TeV+Run4D121_HLT75e33Timing step2 max memory diff 330.1 exceeds +/- 90.0 MiB
  • Error: Workflow 34434.911_TTbar_14TeV+Run4D121_DD4hep step3 max memory diff 323.8 exceeds +/- 90.0 MiB
  • Error: Workflow 34434.911_TTbar_14TeV+Run4D121_DD4hep step2 max memory diff 575.5 exceeds +/- 90.0 MiB
  • Error: Workflow 34496.0_CloseByPGun_CE_E_Front_120um+Run4D121 step3 max memory diff 205.6 exceeds +/- 90.0 MiB
  • Error: Workflow 34496.0_CloseByPGun_CE_E_Front_120um+Run4D121 step2 max memory diff 382.0 exceeds +/- 90.0 MiB
  • Error: Workflow 34500.0_CloseByPGun_CE_H_Coarse_Scint+Run4D121 step2 max memory diff 402.7 exceeds +/- 90.0 MiB
  • Error: Workflow 34500.0_CloseByPGun_CE_H_Coarse_Scint+Run4D121 step3 max memory diff 138.8 exceeds +/- 90.0 MiB

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

@cmsbuild please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49932/47683

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

step2 v5 vs PR, ttbar PU200

Group Phase2Timing_resources_step2_v5 Phase2Timing_resources_step2_v5_pr Delta Phase2Timing_resources_step2_v5_pr Delta % Phase2Timing_resources_step2_v5_pr
Simulation 30583.509 31158.401 +574.891 +1.88%
I/O 17648.297 18157.549 +509.252 +2.89%
DIGI 7633.930 7807.612 +173.682 +2.28%
other|other 7527.334 9863.001 +2335.667 +31.03%
L1 Trigger 3285.062 3401.622 +116.560 +3.55%
TICL|3D Pattern Recognition 3229.220 518.856 -2710.364 -83.93%
TICL|PF Interpretation 1912.113 160.148 -1751.965 -91.62%
idle 1445.342 1401.587 -43.755 -3.03%
Unassigned 965.941 1072.647 +106.706 +11.05%
Validation 900.237 903.849 +3.612 +0.40%
TICL|Linking 571.179 121.226 -449.953 -78.78%
event cleanup 563.523 640.128 +76.606 +13.59%
RecoLocalCalo|HGCAL 435.622 442.392 +6.771 +1.55%
RecoParticleFlow|PFClusterProducer 407.902 384.159 -23.743 -5.82%
Event Setup 378.003 380.617 +2.613 +0.69%
RecoTracking 292.053 287.886 -4.167 -1.43%
RecoVertex 177.351 178.004 +0.653 +0.37%
RecoEcal|EgammaClusterProducers 96.254 96.864 +0.610 +0.63%
RecoParticleFlow|PFProducer 64.204 69.365 +5.161 +8.04%
RecoTracking|MkFit 56.457 57.844 +1.388 +2.46%
JetMET 54.899 55.275 +0.376 +0.69%
TICL|Preparation 32.545 39.568 +7.023 +21.58%
RecoLocalMuon|GEMSegment 13.610 13.646 +0.037 +0.27%
RecoLocalMuon|GEMRecHit 4.817 5.003 +0.185 +3.85%
TICL|HGCAL 1.715 1.711 -0.004 -0.21%
RecoVertex|BeamSpotProducer 0.029 0.028 -0.002 -5.17%
DQMServices|Components 0.011 0.004 -0.007 -66.35%
RecoLuminosity|LumiProducer 0.007 0.011 +0.004 +56.33%
RecoTau 0.000 0.000 0.000 0.00%

step3 v5 vs PR, ttbar PU200

Group Phase2Timing_resources_step3_v5 Phase2Timing_resources_step3_v5_pr Delta Phase2Timing_resources_step3_v5_pr Delta % Phase2Timing_resources_step3_v5_pr
Validation|Tracking 10620.519 10602.111 -18.407 -0.17%
IterativeTracking 10107.502 9745.089 -362.414 -3.59%
I/O 9036.555 8817.318 -219.237 -2.43%
Simulation 7082.391 7083.729 +1.338 +0.02%
Validation 6401.289 6452.345 +51.056 +0.80%
other|other 4969.158 4593.945 -375.213 -7.55%
TICL|3D Pattern Recognition 3509.465 488.203 -3021.261 -86.09%
Unassigned 3312.976 3238.957 -74.019 -2.23%
TICL|PF Interpretation 2127.989 168.113 -1959.876 -92.10%
RecoTracker|FinalTrackSelectors 1879.096 1877.000 -2.096 -0.11%
RecoMuon|MuonIdentification 1697.471 1700.554 +3.084 +0.18%
RecoParticleFlow|PFTracking 1608.432 1562.842 -45.590 -2.83%
Validation|HGCAL 1358.899 1336.158 -22.742 -1.67%
RecoEgamma|EgammaElectronProducers 1238.318 1094.177 -144.141 -11.64%
RecoVertex 1202.527 1201.087 -1.440 -0.12%
RecoMTD|TrackExtender 1027.160 1019.704 -7.457 -0.73%
Validation|TICL 1017.200 998.499 -18.700 -1.84%
RecoParticleFlow|PFProducer 968.615 477.048 -491.567 -50.75%
RecoLocalCalo|HGCAL 915.863 658.143 -257.720 -28.14%
event cleanup 896.618 892.422 -4.197 -0.47%
SimTracker|TrackerHitAssociation 771.643 763.588 -8.054 -1.04%
RecoTracking|MkFit 715.072 714.618 -0.454 -0.06%
RecoVertex|AdaptiveVertexFinder 707.365 704.602 -2.763 -0.39%
SimMuon|MCTruth 679.505 682.265 +2.760 +0.41%
RecoTauTag|Configuration 675.634 1017.384 +341.750 +50.58%
RecoTracking 647.405 646.689 -0.717 -0.11%
PAT 639.920 645.069 +5.150 +0.80%
RecoJets|JetAssociationProducers 623.110 618.262 -4.848 -0.78%
TICL|Linking 585.416 118.845 -466.571 -79.70%
JetMET 572.563 569.733 -2.831 -0.49%
idle 518.022 512.134 -5.888 -1.14%
RecoVertex|Configuration 487.187 486.309 -0.879 -0.18%
Validation|MTD 387.181 381.830 -5.351 -1.38%
Event Setup 312.741 353.739 +40.999 +13.11%
DIGI 310.199 310.031 -0.168 -0.05%
RecoParticleFlow|PFClusterProducer 304.509 293.526 -10.984 -3.61%
RecoJets|JetPlusTracks 290.805 291.348 +0.543 +0.19%
CommonTools|ParticleFlow 290.771 289.096 -1.674 -0.58%
RecoVertex|V0Producer 271.185 271.818 +0.633 +0.23%
TrackingTools|GsfTracking 263.816 44.681 -219.135 -83.06%
RecoParticleFlow|Configuration 209.444 211.615 +2.171 +1.04%
RecoMuon|Configuration 190.629 195.395 +4.766 +2.50%
RecoJets|JetProducers 122.914 120.311 -2.603 -2.12%
RecoBTag|ImpactParameter 107.309 107.565 +0.255 +0.24%
RecoLocalTracker|SiPixelClusterizer 94.060 95.417 +1.357 +1.44%
RecoLocalCalo|ECAL 90.911 90.894 -0.018 -0.02%
RecoMuon|CosmicMuonProducer 68.438 70.483 +2.044 +2.99%
RecoLocalTracker|SiPixelRecHits 66.836 67.463 +0.627 +0.94%
RecoEgamma|EgammaPhotonProducers 66.294 45.416 -20.878 -31.49%
RecoTau 66.257 162.328 +96.071 +145.00%
RecoMuon|GlobalMuonProducer 59.150 58.766 -0.384 -0.65%
RecoMET|METProducers 56.064 56.089 +0.025 +0.05%
EventFilter|HGCalRawToDigi 52.569 51.279 -1.290 -2.45%
SimTracker|TrackAssociation 45.487 45.426 -0.061 -0.13%
CommonTools|RecoAlgos 39.672 40.307 +0.635 +1.60%
RecoBTag|SecondaryVertex 35.524 36.230 +0.706 +1.99%
RecoMuon|StandAloneMuonProducer 25.487 25.028 -0.459 -1.80%
TICL|Preparation 25.352 25.103 -0.249 -0.98%
RecoEcal|EgammaClusterProducers 25.076 59.948 +34.872 +139.06%
RecoLocalFastTime|FTLClusterizer 22.545 18.182 -4.362 -19.35%
RecoTracker|DeDx 20.226 20.221 -0.005 -0.02%
Configuration|StandardSequences 19.164 19.001 -0.162 -0.85%
RecoPixelVertexing|PixelLowPtUtilities 17.820 18.558 +0.738 +4.14%
RecoLocalFastTime|FTLRecProducers 16.829 14.974 -1.855 -11.02%
RecoLocalMuon|GEMSegment 13.636 13.657 +0.020 +0.15%
RecoLocalCalo|HCAL 13.548 12.971 -0.577 -4.26%
RecoTracker|CkfPattern 7.807 7.506 -0.302 -3.87%
ParticleFlow|ParticleSelectors 6.231 6.151 -0.079 -1.27%
RecoBTag|Combined 5.347 5.260 -0.088 -1.64%
ParticleFlow|Isolation 5.293 5.195 -0.098 -1.85%
RecoEgamma|EgammaIsolationAlgos 4.917 4.992 +0.075 +1.53%
RecoLocalMuon|GEMRecHit 4.772 4.702 -0.070 -1.47%
RecoLocalTracker|SubCollectionProducers 4.045 4.061 +0.016 +0.40%
RecoLocalTracker|SiPhase2Clusterizer 4.044 3.963 -0.081 -2.01%
RecoLocalMuon|DTSegment 3.996 3.975 -0.021 -0.53%
TICL|HGCAL 2.756 2.365 -0.391 -14.19%
RecoLocalMuon|CSCRecHitD 2.691 2.626 -0.065 -2.42%
RecoTracker|ConversionSeedGenerators 2.672 2.657 -0.015 -0.56%
RecoJets|Configuration 2.664 2.694 +0.031 +1.16%
RecoLocalMuon|CSCSegment 2.654 2.714 +0.060 +2.25%
RecoMuon|GlobalTrackingTools 2.303 2.281 -0.022 -0.96%
RecoMuon|MuonIsolation 2.232 2.218 -0.014 -0.62%
RecoTauTag|RecoTau 2.051 3.451 +1.400 +68.28%
RecoBTag|CTagging 0.993 1.004 +0.012 +1.17%
RecoTracker|TrackProducer 0.881 0.886 +0.005 +0.56%
RecoMuon|MuonSeedGenerator 0.689 0.665 -0.024 -3.48%
EventFilter|L1TRawToDigi 0.677 0.490 -0.187 -27.63%
RecoBTag|SoftLepton 0.595 0.533 -0.062 -10.44%
L1 Trigger 0.556 0.523 -0.032 -5.84%
Validation|PF 0.506 0.488 -0.018 -3.52%
L1Trigger|Configuration 0.407 0.224 -0.183 -44.95%
RecoLocalMuon|DTRecHit 0.384 0.368 -0.016 -4.24%
RecoEgamma|EgammaHFProducers 0.311 0.284 -0.027 -8.83%
RecoEgamma|ElectronIdentification 0.294 0.258 -0.036 -12.35%
RecoLocalMuon|RPCRecHit 0.263 0.241 -0.023 -8.56%
RecoTracker|MeasurementDet 0.231 0.243 +0.012 +5.21%
RecoParticleFlow|PFSimProducer 0.161 0.162 +0.002 +1.09%
JetMETCorrections|Configuration 0.090 0.072 -0.018 -20.32%
EventFilter|CTPPSRawToDigi 0.082 0.047 -0.035 -42.38%
RecoMuon|MuonIsolationProducers 0.081 0.060 -0.021 -26.02%
RecoCTPPS|TotemRPLocal 0.070 0.049 -0.021 -29.79%
RecoVertex|BeamSpotProducer 0.059 0.032 -0.027 -45.95%
EventFilter|L1TXRawToDigi 0.056 0.039 -0.017 -30.28%
FWCore|Modules 0.037 0.023 -0.014 -37.23%
RecoCTPPS|PixelLocal 0.027 0.018 -0.009 -32.87%
RecoEgamma|PhotonIdentification 0.026 0.027 +0.001 +4.60%
RecoTracker|TkSeedGenerator 0.019 0.010 -0.009 -48.61%
SimTracker|TrackAssociatorProducers 0.017 0.017 +0.000 +0.65%
EventFilter|ScalersRawToDigi 0.016 0.014 -0.002 -11.71%
RecoLuminosity|LumiProducer 0.013 0.011 -0.003 -20.80%
RecoCTPPS|ProtonReconstruction 0.009 0.009 -0.001 -7.46%

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

type ngt

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 8, 2026

are any further checks needed?

@Moanwar if you are satisfied with the reconstruction changes feel free to sign for reco.

@Moanwar
Copy link
Copy Markdown
Contributor

Moanwar commented May 8, 2026

Hi @mmusich , welcome back. Well, from what has been shown so far, the PR looks to be in good shape. However, I thought it would still be better to check whether any additional tests might be needed, which is why I asked you.
Do you think there are any other checks or tests that should be run for this PR?

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 8, 2026

Do you think there are any other checks or tests that should be run for this PR?

not really, I will take some time to digest all the numbers and discussion above before signing for HLT.

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 8, 2026

+1

looks like the PR tests are not available anymore

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 8, 2026

@cmsbuild, please test

  • to refresh the comparisons

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 11, 2026

@smuzaffar tests look stuck here, can you have a look?

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 13, 2026

@cmsbuild, please abort

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 13, 2026

@cmsbuild, please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 28KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-667298/53214/summary.html
COMMIT: b975a7e
CMSSW: CMSSW_17_0_X_2026-05-12-2300/el8_amd64_gcc13
Additional Tests: HLT_P2_INTEGRATION,HLT_P2_TIMING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/49932/53214/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-667298/53214/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-667298/53214/git-merge-result

HLT P2 Timing: chart

Comparison Summary

Summary:

  • You potentially removed 422 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 6041 differences found in the comparisons
  • DQMHistoTests: Total files compared: 66
  • DQMHistoTests: Total histograms compared: 4560893
  • DQMHistoTests: Total failures: 10257
  • DQMHistoTests: Total nulls: 1
  • DQMHistoTests: Total successes: 4550615
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 27889.836000000007 KiB( 65 files compared)
  • DQMHistoSizes: changed ( 34434.0,... ): 1295.576 KiB HLT/HGCAL
  • DQMHistoSizes: changed ( 34434.0,... ): 844.816 KiB HGCAL/HGCalValidator
  • DQMHistoSizes: changed ( 34434.0,... ): -22.112 KiB HGCAL/PFCandidates
  • DQMHistoSizes: changed ( 34434.0,... ): -1.207 KiB HGCAL/0
  • DQMHistoSizes: changed ( 34496.0 ): -0.008 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 34434.7521 ): 884.773 KiB HLT/HGCAL
  • DQMHistoSizes: changed ( 34434.771 ): 1303.584 KiB HLT/HGCAL
  • DQMHistoSizes: changed ( 34434.775,... ): 1727.969 KiB HLT/HGCAL
  • Checked 276 log files, 236 edm output root files, 66 DQM output files
  • TriggerResults: found differences in 19 / 64 workflows

Max Memory Comparisons exceeding threshold

@cms-sw/core-l2 , I found 2 workflow step(s) with memory usage exceeding the error threshold:

Expand to see workflows ...
  • Error: Workflow 34434.7521_TTbar_14TeV+Run4D121_HLT75e33TimingTiclV5TrackLinkGNN step2 max memory diff -170.8 exceeds +/- 90.0 MiB
  • Error: Workflow 34434.771_TTbar_14TeV+Run4D121_NGTScoutingAll step2 max memory diff -169.4 exceeds +/- 90.0 MiB

@Moanwar
Copy link
Copy Markdown
Contributor

Moanwar commented May 13, 2026

Nice, I am not sure what changed, but the number of workflows above the memory threshold has dropped a lot since the last test.

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 13, 2026

For the record the change in timing is the following reported by the bot at #49932 (comment):

HLT timing menu (on GPU)

CMSSW_17_0_X_2026-05-12-2300 CMSSW_17_0_X_2026-05-12-230 + This PR
Screenshot from 2026-05-13 14-17-47 Screenshot from 2026-05-13 14-17-54

The net time saving per event is 6288.0 ms - 5875.3ms = 412.7ms (i.e. $\color{Green}\Large{\textbf{-6.5\%}}$)

HLT timing menu (on CPU)

CMSSW_17_0_X_2026-05-12-2300 CMSSW_17_0_X_2026-05-12-230 + This PR
Screenshot from 2026-05-13 14-18-02 Screenshot from 2026-05-13 14-18-08

The net time saving per event is 8513.0 ms -8079.9 ms = 433.1 ms (i.e. $\color{Green}\Large{\textbf{-5.08\%}}$)

NGT scouting menu

CMSSW_17_0_X_2026-05-12-2300 CMSSW_17_0_X_2026-05-12-230 + This PR
Screenshot from 2026-05-13 14-17-32 Screenshot from 2026-05-13 14-17-41

The net time saving per event is 7414.5ms - 6836.7ms = 577.8ms (i.e. $\color{Green}\Large{\textbf{-7.8\%}}$)

As expected the GPU memory usage is unvaried (within measurement uncertainties), e.g. log:

image

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 13, 2026

+hlt

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 13, 2026

@felicepantaleo , just for my education, is it expected that e.g. in the "vanilla" Phase-2 workflow wf 34434.0, the HLT validation plots in HLT / HGCAL / HGCalValidator / hltTiclTracksterLinksSuperclusteringDNN are all empty?
Is this iteration run by default?

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

@mmusich yes, the superclustering DNN efficiency is still low and the model needs retuning. It might be that the iteration has run, but for this tight configuration it did not find any supercluster.

@felicepantaleo
Copy link
Copy Markdown
Contributor Author

Could you please check this and sign?
@cms-sw/simulation-l2 @cms-sw/reconstruction-l2 @cms-sw/ml-l2 @cms-sw/pdmv-l2 @cms-sw/dqm-l2

@Moanwar
Copy link
Copy Markdown
Contributor

Moanwar commented May 15, 2026

+1

  • Ohh i believed i already did :)

@gabrielmscampos
Copy link
Copy Markdown
Member

+dqm

@civanch
Copy link
Copy Markdown
Contributor

civanch commented May 16, 2026

+1

@AdrianoDee
Copy link
Copy Markdown
Contributor

+pdmv

@mmusich
Copy link
Copy Markdown
Contributor

mmusich commented May 18, 2026

@cms-sw/ml-l2 your signature is required here.

@y19y19
Copy link
Copy Markdown
Contributor

y19y19 commented May 18, 2026

+ml

@cmsbuild
Copy link
Copy Markdown
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @ftenchini (and backports should be raised in the release meeting by the corresponding L2)
Notice This PR was tested with additional Pull Request(s), please also merge them if necessary: cms-data/RecoHGCal-TICL#12

@mandrenguyen
Copy link
Copy Markdown
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.